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The Condition of Certain Matrices, III ! 

John Todd 2 

v The condition-numbers of certain matrices associated with various discretizations of the 

two-dimensional Laplacian operator are estimated. The condition-number gives an estimate 

of the error obtained by solving the corresponding systems of simultaneous linear equations. 

1. Introduction. In a previous paper [Todd, 8a] 3 the condition of a matrix associated with 
a particular method of solving a simple partial differential equation was discussed. Certain 
experimental computations of D. M. Young and his collaborators [Young, 13] suggested the 
discussion of other methods of handling the same equation. The P-condition number of a 
matrix Mis defined as X/m where X is the maximum and /a is the minimum of the absolute values 
of the eigenvalues of M; it gives a measure of the difficulty in the numerical inversion of M, or, 
more precisely, of an error in the inverse computed by an elimination method [von Neumann 
and Goldstine, 11; Todd, 8a, 9]. 

In [8a] we considered the solution of the Laplace equation in a unit square, with given 
boundary values. We then used the following five-point approximation to the Laplace operator: 

(1.1) Zss+Zn : h- 2 [z(r-l,s) + z(r,s-l)-4z(r,s) + z(r,s+l) + z(r+l,s)], 

where z(r,s)=z(rh,sh) and h=l/(n-{-l), n a positive integer. Following Milne [4, p. L31] we 
indicate this approximation by the "stencil" 
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(This has been called a "computational molecule" by Bickley [2]). The n 2 Xn 2 matrix which 
corresponds to the ('([nations for the z(r,s) can be indicated as 



Z x =\. . . ,/,A\/.. . .1 where Z=l . . .,1,-4,1, . . . I 

is an nXn matrix and / is the wXw unit matrix. Here, and elsewhere, for brevity, we have 
indicated only the general row in the triple diagonal matrices. For clarity we describe A x and 
X\\\ words. The matrix 7j X is an ri 2 Xn~ matrix partitioned into nXn blocks; of these the diag- 
onal blocks are all X and the blocks adjacent to the diagonal are unit matrices. The matrix X 
is an nXn matrix with diagonal elements all —4 and tin 4 elements adjacent to the diagonal 
all 1: In symbols X=(x lj ) where x ti = —4, i=l,2, . . . n, and for i^j, x tj =0 unless \i— -j| = l, 
when x ij =l. 

The equations corresponding to the problem 

2^+2^=0 ni interior, z = f on boundary 
can be writ t en as 

Z,z=f 



i The problems considered here were suggested by lectures of D. M.Young, Jr., in the National Bureau of Standards-National Science Founda 
lion Training Program in Numerical Analysis held In 1957. 
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where the variables z(r,s) are combined as the 7fc 2 -dimensional vector: 
z=(z(l y n), z(2,n), . . 



z(n,n); z(l,w— 1), s(2,n— 1), . 
2(n,?i — ] ); 



; -(1,1), 0(2,1), . . . , z(n,l)) 



and where 



,, f(n,0) +./'(// + 1,1)). 



-f=(f(0,w)+/(l,»+l),/(2,n+l), . . . ,/(w,w+l)+/(w+l,»); 

/(0,n-l),0, . . .,/(w+l,n-lj; . . . ;/(0,l)+/(l,0), /(2,0), . 

The essential result established in [8] was that 

P(Z 1 )=4w- 2 n 2 . 

We shall now obtain the corresponding results for other discretizations of the Laplacian [Panow 

5, Bickley 2]. 

2. Auxiliary results. We require the following results: 

(2.1) The characteristic values of the triple diagonal matrix of order n: 



C- 



( 



., c, a, 6, 



) 



are 

where 



\ k =a— 2-y[Q)c) cos k6, &=1,2, . . .,n 

r riiis is well known ; it is easily proved by solving the difference equation 

A n (X) = (a-X)A tt _ 1 (X)~6cA M _ 2 (X) 

for the characteristic polynomial A n (\) = \C—\I\. 

We shall use the notation 6=w/(n+l) throughout this paper. 

(2.2) The characteristic roots of the quintuple diagonal matrix of order n: 

Z—P, 2a, 

2«, 2, 2a, fi 

0, 2a, z, 2a, 

0, 2a, z, 2a, 

j8, 2a, z y 2a, 
jS, 2a, 2, 2a 
0, 2a, -0 



ar^ 



X fc =^-20— /3" 1 {a 2 -(a-20 cos &0) 2 }, i=l,2, 



,71. 



This result lias been given by Rutherford [6, 7], It can be verified as follows: If in the 
matrix C we put c = b and square we obtain essentially the matrix A. In fact if we choose 

6-=V^«=«/v% then 

A = C 2 +(z-a 2 t3- l -2p)L 

(2.1V) Let F be a matri.i of order /r, partitioned into an array of ir submatrices ./,,, each <>i 
order n, such that each f tj is a rational function f u (a) of a fixed matrix a, of order n . If the char- 
acteristic values of sl are a,, a 2 «„ then those of F are given by f/t< characteristic values of tin 

n matrices 

(/,->,-)), £=1,2, . . ..//, 
/ ach of order n. 

This has been established by Williamson [12]; for extensions see AlViat [1|. 

3. We begin by discussing another five-point approximation which is represented by the 
stencil 
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Omitting the factor^ we see thai the corresponding /rX/r matrix is 



Z, .... X, -4/, X, 



where 



X= 



is an nXn matrix and / t he n :< n unit matrix. The characteristic values of X are, from (2.1), 

—2 cos k6, £'=1,2, . . . ,n. 
It follows that those of Z> are those of the n triple diagonal matrices 

Z 2 (fc) = ( . . . , -2 cos kd, -4, -2 eos kd, ... J, 4=1,2,... ,n, 



which are, from (2.1), 

,, M = _4[l-|- C os Jt0 cos /0], • k=l,2 f . . . ,n, 

We have 

\(Z 2 )=4[l+cos 2 0] 

M (Z 2 )=4 sin 2 

so that 

P(Z 2 )=27r- 2 n 2 . 



Z=l,2, 



. ,n. 



4. We next discuss the nine-point approximation represented by the stencil 

(I 4 n 

4 -20 4 
U 4 I) 

Omitting the factor -, we see that the corresponding n 2 Xn 2 matrix is 



( 



Z 3 = . . . , Y, X, T, . . 



) 



where 



( 



Z=| . . . , 4, -20, 4, . . 



) 



and Y= 



( 



1, 4, 1, 



) 



We note that (2.3) will apply since 



Y=^X+9L 



The characteristic values of X are 

-20— 8 cos kd, &=1,2, . . ., n. 
It follows that the characteristic values of Z 3 are those of the n matrices 



z, 3 - 



( 



. . ., 4 — 2 cos kd, —20 — 8 cos &0, 4 — 2 cos kd, . . . 



) 



which are 

= _20 — 8 cos kd— 8 cos Z0+4 cos &0 cos Z0, ^=1,2, . . ., n, 2=1,2, 



Hence 
which gives 



X(Z 3 )=n,i# = 32 
^(Z 3 )=^, W =12A- 2 



P(Z 3 )^|x- 2 n 2 . 



7L 



5. We conclude by discussing the nine-point approximation represented by the stencil 

0-10 (T 
16 
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16 
0-10 
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This stencil must be modified for points near the boundary. Thus, at the corner (1,7?), we use 

oo o" 

14 

14 -58 16 -1 

16 

-1 

(his moans that we have estimated the outside value by linear interpolation on the two nearest 
values on the same line. For points (r,s) at the edge, i. e., r=l or r=n or 8=1, s=n which 
are not corners, e. g., r=l, s=n— 1, we liave to use a stencil of the form: 



14 

-1 16 -59 16 -1 

16 

-1 

Omitting the factor }{ 2 we see that the corresponding n 2 Xn 2 matrix is 

fZ+I, 167, -7 

107, Z, 167, -I 

-I, 167, Z, 167, -I 



z<= 



12 



-7, 167, Z, 167, -7 
-7, 167, Z, 167 
-7, 167, Z+IJ 



where Z is the nXn matrix: 

f-59, 16, -1 



Z= 



16, -60, 16, -1 
-1, 16, -60, 16, -1 



•1, 16, -60, 16, -1 
-1, 16, -60, 16 
-1, 16, -59J 



From (2.2) the characteristic values of Z are 






A,= -60 + 2+{64-(8 + 2 cos kB) 2 } , k=\ 


,2, . . ., n, 




and by (2.3) the characteristic roots of Z 4 are those of the n matrices 






'Xj+1, 16, -1 








16, X,,, 16,-1 








-1,16, X», 16. -1 






Z ( /> = 


-1, 16, X A , 16, -1 
-1, 16, X,, 16 

-1,16, X A + 1 > 


k=l,2,. 




which are, again using (2.2), 






e M = X*+2+{64— (8+2 oos Id)-), £=1.2 n 


1=1,2,.. 


.,« 


= X,, + X, + 60. 






It follows that 

X(Z 4 )=v 1 ,, = 128 






so that 


n{Z,) = v, Kn ^2Air' i ,r 1 







P(Z 4 )=^ 2 -^ 2 . 

6. An evaluation of the various methods could now be made. In addition to the in- 
version error, which is given in terms of the P-condition number by von Neumann and Gold- 
stine, the truncation error must be considered. The local truncation errors for the various 
stencils have been given by Bickley [2]; however, it seems that the global truncation errors 
have been studied only in the case of the approximation (1.1) by S. A. Gerschgorin, P. C. Rosen- 
bloom, J. L. Walsh, W. Wasow, and others. We shall not, however, carry out an evaluation, 
for it seems clear that the elimination method is not the most suitable one for problems involv- 
ing sparse matrices; numerical experience, nevertheless, does show that the P-condition number 
of a matrix is a good indication of the intrinsic difficulty of the inversion problem. 

7. Remarks. 

(1) Dr. Young pointed out that our results could be obtained by solving the difference 
equations by separating the variables (cf., e. g., B. Friedman [3]). 

(2) As in [8] the estimates of the iV-condition of Turing [10] can be obtained, since we 
know all the eigenvalues of the matrices in question. 

(3) Similar results can be obtained for the biharmonic equation (cf. [9]). 

(4) I take this opportunity to correct slips in two papers in this series. 

In p. 117 of [8] the expression for y kj for j<k<n should read (n-\-l)y kj =—k(n— j-f-l) + 
(n+1) (k—j). This was pointed out by D. E. Rutherford [7]. 

In p. 471 of [8a], line 3, the adjective "symmetric" (or "normal") should be inserted to 
qualify "matrix''. This was pointed out in conversation by Martin Pearl. 
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